Goto

Collaborating Authors

 mental time travel


Towards mental time travel: a hierarchical memory for reinforcement learning agents

Neural Information Processing Systems

Reinforcement learning agents often forget details of the past, especially after delays or distractor tasks. Agents with common memory architectures struggle to recall and integrate across multiple timesteps of a past event, or even to recall the details of a single timestep that is followed by distractor tasks. To address these limitations, we propose a Hierarchical Chunk Attention Memory (HCAM), that helps agents to remember the past in detail. HCAM stores memories by dividing the past into chunks, and recalls by first performing high-level attention over coarse summaries of the chunks, and then performing detailed attention within only the most relevant chunks. An agent with HCAM can therefore mentally time-travel--remember past events in detail without attending to all intervening events.


Towards mental time travel: a hierarchical memory for reinforcement learning agents

Neural Information Processing Systems

Reinforcement learning agents often forget details of the past, especially after delays or distractor tasks. Agents with common memory architectures struggle to recall and integrate across multiple timesteps of a past event, or even to recall the details of a single timestep that is followed by distractor tasks. To address these limitations, we propose a Hierarchical Chunk Attention Memory (HCAM), that helps agents to remember the past in detail. HCAM stores memories by dividing the past into chunks, and recalls by first performing high-level attention over coarse summaries of the chunks, and then performing detailed attention within only the most relevant chunks. An agent with HCAM can therefore "mentally time-travel"--remember past events in detail without attending to all intervening events.


On the link between conscious function and general intelligence in humans and machines

Juliani, Arthur, Arulkumaran, Kai, Sasai, Shuntaro, Kanai, Ryota

arXiv.org Artificial Intelligence

In popular media, there is often a connection drawn between the advent of awareness in artificial agents and those same agents simultaneously achieving human or superhuman level intelligence. In this work, we explore the validity and potential application of this seemingly intuitive link between consciousness and intelligence. We do so by examining the cognitive abilities associated with three contemporary theories of conscious function: Global Workspace Theory (GWT), Information Generation Theory (IGT), and Attention Schema Theory (AST). We find that all three theories specifically relate conscious function to some aspect of domain-general intelligence in humans. With this insight, we turn to the field of Artificial Intelligence (AI) and find that, while still far from demonstrating general intelligence, many state-of-the-art deep learning methods have begun to incorporate key aspects of each of the three functional theories. Having identified this trend, we use the motivating example of mental time travel in humans to propose ways in which insights from each of the three theories may be combined into a single unified and implementable model. Given that it is made possible by cognitive abilities underlying each of the three functional theories, artificial agents capable of mental time travel would not only possess greater general intelligence than current approaches, but also be more consistent with our current understanding of the functional role of consciousness in humans, thus making it a promising near-term goal for AI research.


The Tricky Problem with Other Minds - Issue 75: Story

Nautilus

Human "exceptionalism" is for many people an unquestioned assumption. For the religious, it is a God-given fact; for humanists, it is a celebration of our unique mental capacities.


Ravens can plan ahead just like humans and great apes

Daily Mail - Science & tech

Ravens are known for being remarkably intelligent. Now a new study has revealed that these clever birds plan for the future, just like us. They can imagine future events via'mental time travel' and are capable of exercising self-control to delay gratification, researchers found. This skill of future planning was thought to be exclusive to humans and great apes. As ravens and great apes have not shared a common ancestor for more than 300 million years, these results suggest'planning' abilities evolved independently of one another.